Removable arm-type base plate drawbars for your 1996 Saturn SL2, such as those in the Roadmaster # 52181-1 and the Blue Ox # BX3310 that are shown on the link at right, should not be too difficult to remove. I am concerned that the difficulty you are having removing the one drawbar could be a result of an impact or other damage.
Has this system been in use for some time or is it new?
If it is a new system then I urge you to take it to the place of purchase for inspection.
If its been... view full answer...